[email protected] Using CBIR Technology in InteractiveWeb-TV

The increasing amount of internet based television broadcasts has lead to new approachs to interactivity in TV programs. We developed a system which is able to supply the viewer of the program upon interaction with information relating to the program, only based on the low-level visual content of the scene. This aim is achieved by comparing signatures describing the visual content of single frames of the video with a remote database of signatures derived from known videos. The database actually links the visual information contained in the signatures to some second-level information interesting for the user. Two main problems in extending CBIR technology to videos must be overcome, one is the extraction of the visual information out of the highly redundant video material, and the other is reducing the matching time of the system enough to allow for web-based interactivity.